Detecting emotions during a memory training assisted by a social robot for individuals with Mild Cognitive Impairment (MCI)

The attention towards robot-assisted therapies (RAT) had grown steadily in recent years particularly for patients with dementia. However, rehabilitation practice using humanoid robots for individuals with Mild Cognitive Impairment (MCI) is still a novel method for which the adherence mechanisms, indications and outcomes remain unclear. An effective computing represents a wide range of technological opportunities towards the employment of emotions to improve human-computer interaction. Therefore, the present study addresses the effectiveness of a system in automatically decode facial expression from video-recorded sessions of a robot-assisted memory training lasted two months involving twenty-one participants. We explored the robot’s potential to engage participants in the intervention and its effects on their emotional state. Our analysis revealed that the system is able to recognize facial expressions from robot-assisted group therapy sessions handling partially occluded faces. Results indicated reliable facial expressiveness recognition for the proposed software adding new evidence base to factors involved in Human-Robot Interaction (HRI). The use of a humanoid robot as a mediating tool appeared to promote the engagement of participants in the training program. Our findings showed positive emotional responses for females. Tasks affects differentially affective involvement. Further studies should investigate the training components and robot responsiveness

Social robots in cognitive interventions. Advances, problems and perspectives

Social Assistive Robots are being used in therapeutic interventions for elderly people affected by cognitive impairments. The present paper reports our research lines aiming at investigating the role of a social robot in aiding therapists during cognitive stimulation sessions for elders with Mild Cognitive Impairment and Mild Dementia. We review our studies whose results show that social robots have been positively accepted by the seniors in different experiments. Participants were very attentive and involved in the sessions’ tasks and their experience was mainly positive. Our data suggest that this technology can be a valid tool to support psychotherapists in cognitive stimulation interventions emphasizing the need of multidisciplinary approaches combining assessment of behavior and robotics

Evaluating natural interaction with a shop window

This paper ∗ describes the evaluation of two interaction modalities for Active Fashion, the first prototype of system designed for providing interactively information about dresses shown on mannequins in a shop window. Using the system the user may look at available sizes, colors, price and similar products. Due to the nature of such a system, the interaction must be touch-less and natural. The developed solutions use Microsoft Kinect 2 as a device. The first modality is based on gestures while the second one is based on gaze pointing. Evaluation results show that even if the interaction did not result completely satisfying from the control point of view, users prefer the gaze-based approach and felt positively engaged during the interaction

A multimodal interface for robot-children interaction in autism treatment

Recent studies suggest that robots play an important role to cope Autistic Spectrum Disorder (ASD). This paper presents a multimodal interface based on a multilevel treatment protocol customized to improve eye contact, joint attention, and imitation. An evaluation of the system has been performed involving 6 high functioning children with autism spectrum disorders. The experiments carried out make it possible to evaluate the behavioral response of the children in the eye contact exercise. ASD children had achieved better results than traditional therapy thanks to the multimodal interface

A comparative study on soft biometric approaches to be used in retail stores

Soft biometric analysis aims at recognizing personal traits that provide some information about the individual. In this paper, we implemented and compared several approaches for soft biometric analysis in order to analyze humans soft biometric traits: age, gender, presence of eyeglasses and beard. Convolutional Neural Netoworks can be successfully used to understand soft biometric traits of passers-by looking at public displays and at shop windows

Artificial intelligence for robot-assisted treatment of autism

Designing robot-based treatments for children with Autistic Spectrum Disorder (ASD) is a growing research field. This paper presents an artificial intelligence system based on a robot-assisted treatment of autism. The robot acts as a social mediator, trying to elicit specific behaviors in autistic children. A first preliminary evaluation of the system has been performed involving 3 high functioning children with autism spectrum disorders. The experiments carried out make it possible to evaluate the behavioral response of the children in the eye contact exercise

Facial expression recognition from nao robot within a memory training program for individuals with mild cognitive impairment

Mild Cognitive Impairment refers to a borderline state between healthy aging and dementia. Memory-training program plays a crucial role in the reduction of the possible conversion in dementia and a robot mediated memory training is useful to overcome limits of traditional programs. The present study addresses the effectiveness of a system in automatically recognize facial expression from video recorded sessions of a robot mediated memory training lasted 2 months involving 21 patients. The system is able to recognize facial expressions from group sessions handling partially occluded faces. Findings showed that in all participants the system is able to recognize facial expressions

Facial expression recognition from nao robot within a memory training program for individuals with mild cognitive impairment

Mild Cognitive Impairment refers to a borderline state between healthy aging and dementia. Memory-training program plays a crucial role in the reduction of the possible conversion in dementia and a robot mediated memory training is useful to overcome limits of traditional programs. The present study addresses the effectiveness of a system in automatically recognize facial expression from video recorded sessions of a robot mediated memory training lasted 2 months involving 21 patients. The system is able to recognize facial expressions from group sessions handling partially occluded faces. Findings showed that in all participants the system is able to recognize facial expressions